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BRIEF 


This  is  a  methodological  report  of  the  effects  of  re¬ 
peated  administration  of  the  Career  Motivation  questionnaire. 

Repeated  exposure  to  the  questionnaire  did  not  have  an 
adverse  effect  on  the  questionnaire  returns  nor  on  reenlist- 
ment  intentions.  Some  tendency  was  found  for  those  men  who 
received  a  questionnaire  to  remain  in  the  Navy  more  often 
than  those  who  did  not  receive  any  questionnaire. 
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STUDIES  IN  CAREER  MOTIVATION!  EFFECTS 
OF  REPEATED  QUESTIONNAIRE  ADMINISTRATION  ON 
RETURNS  AND  ON  INTENDED  AND  ACTUAL  REENLI SIM ENT 


PURPOSE  AND  DESIGN  OF  THE  STUDY 


The  basic  design  of  the  Career  Motivation  Survey  in¬ 
volved  administration  of  the  same  questionnaire  to  identical 
or  equivalent  groups  of  sailors  at  several  points  during 
the  oourse  of  their  first  enlistment,  all  of  whom  entered 
the  Navy  at  about  the  same  time.  The  purposes  of  the  re¬ 
search  were  to  determine*  (a)  how  ami  when  attitudes  change 
during  the  first  enlistment*  (b)  whether  these  attitude 
changes  are  related  to  reeniistment;  (c)  what  experiences 
and  circumstances  affect  these  attitudes?  (d)  when  these 
attitudes  become  fixed?  and  (e)  how  well  and  how  soon  reen¬ 
iistment  can  be  predicted  on  the  basis  of  these  attitudes. 

The  experimental  design,  discussed  in  detail  by  Giickman, 
Learner  and  Spector  (1959),  is  comprised  of  groups  in  a  ver¬ 
tical  and  a  diagonal  sequence.  The  diagonal  sequence  includes 
all  instances  in  which  the  groups  were  exposed  to  the  ques¬ 
tionnaire  for  the  first  time  after  different  amounts  of  time 
spent  in  the  Navy.  The  vertical  sequence  involves  the  same 
people  who  were  given  the  questionnaire  one,  two,  or  three 
times,  subsequent  to  their  first  encounter  with  the  question¬ 
naire,  with  varying  times  intervening  between  administrations. 
This  aspect  of  the  design  enables  ^ne  to  trace  the  changes 
in  response  pattern  of  specific  inc Ividuals  from  one  admin¬ 
istration  time  to  another.  It  also  makes  possible  evaluation 
of  "instrument  effects,"  i.e. ,  the  effect  of  responding  to 
the  questionnaire  more  than  once. 

This  paper  reports  the  effects  of*  (1)  repeated  admin¬ 
istration  of  the  questionnaire  on  intended  and  actual  reen¬ 
iistment;  (2'  administration  versus  non-administration  of 
the  questionnaire  on  actual  reeniistment  and;  (3)  repeated 
administrations  upon  the  proportion  of  questionnaires  returned. 


DESCRIPTION  OF  THE  QUESTIONNAIRE 


The  description  of  the  development  and  pretest  of  the 
questionnaire  and  a  complete  copy  is  available  in  a  previous 
report  (Giickman  &  Learner,  1959).  In  brief,  the  CAMOSUR 
XI  is  a  59-item  questionnaire  comprised  of  three  parts. 
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The  first  part  has  39  Navy-related  attitude  items,  all 
phrased  so  that  the  respondent  can  Strongly  Agree,  Agree,  ' 
Disagree,  or  Strongly  Disagree.  Of  the  14  items  in  Part  II, 
half  are  of  the  error-choice  type  and  are  intended  to  meas¬ 
ure  some  impressions  of  the  men  which  may  affect  or  reflect 
their  cpinions  and  attitudes.  The  six  items  in  Part  III 
ask  for  information  about  the  man  before  he  came  into  the 
Navy,  such  as  place  of  origin  and  salary  earned,  and  are 
filled  in  only  the  first  time  the  man  completes  the  ques¬ 
tionnaire. 

The  intermediate  criterion  item,  which  provides  a  meas¬ 
ure  of  reenlistment  intention,  appears  as  item  48  in  CAMOSUR 
XI  and  is  shown  below. 

48.  What  are  you  most  likely  to  do  after  your  first 

enlistment? 

a.  Work  for  an  employer,  on  salary,  wages  or 
commission. 

b.  Go  to  full  time  school  or  college. 

c.  Farm  for  myself, 

d.  Have  my  own  business. 

e.  Reenlist  in  tne  Navy. 

f.  I  haven't  decided  what  I  will  do. 

Responses  to  the  criterion  item  are  dichotomized,  al¬ 
ternative  e  against  all  others. 


METHOD  OF  ADMINISTRATION 


Administrations  1  and  2  took  place  at  the  three  Recruit 
Training  Commands  in  operation  in  1956.  CAMOSUR  XI  was 
administered,  by  experienced  Personnelmen,  to  every  incoming 
male  recruit  until  the  requisite  sample  had  been  obtained. 

All  subsequent  administrations  took  place  at  the  sub¬ 
ject's  duty  station.  A  self-administered  questionnaire 
and  return-addressed  envelope  were  mailed  to  the  subject 
via  his  commanding  officer. 


STATISTICAL  ANALYSIS 


Effects  of  Repeated  Administration 

It  was  originally  hypothesized  chat  greater  frequency 
of  exposure  to  the  questionnaire  would  be  associated  with 
a  greater  distortion  of  response  although  it  was  not  fore¬ 
cast  just  what  direction  this  distortion  would  take.  One 
might  argue  that  repeated  administrations  would  create  an 
adverse  attitude  on  the  part  of  the  subject  or  that  repeti¬ 
tive  administration  might  increase  the  person's  sensitivity 
to  certain  aspects  of  the  problem. 

In  addition  it  did  not.  seem  unreasonable  to  suppose 
that  the  more  frequently  a  group  was  requested  to  fill  out 
the  questionnaire  the  less  likely  they  would  be  to  comply 
with  this  request.  This  would  be  reflected  in  a  smaller 
proportion  of  the  group  returning  the  questionnaire  on  re¬ 
peated  administrations. 

In  order  to  ascertain  the  effects  of  repeated  adminis¬ 
trations  upon  reenlistment  intentions,  within  each  adminis¬ 
tration  period  comparisons  were  made  of  those  groups  who 
received  the  questionnaire  once  with  those  who  received  it 
two  or  more  times.  A  breakdown  of  these  figures  is  given 
in  Table  1. 
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The  percent  return  shown  here  is  the  number  of  people 
out  of  the  original  sample  who  returned  the  completed  ques¬ 
tionnaire,  Within  each  administration  period  (2,  3,  4,  6 
and  8),  the  differences  between  the  number  of  people  who 
responded  to  the  questionnaire  once  versus  more  than  once 
(i.e.  once  vs,  twice,  once  vs,  twice  vs,  .thrice,  etc,  as 
the  case  may  warrant)  are  not  significant  by  Chi  square  test 
(Walker  &  Lev,  1953),  The  decline  over  time  in  the  absolute 
proportion  of  respondents  is  caused  by  the  attrition  of  sub¬ 
jects  due  to  medical  and  disciplinary  discharges,  minority 
enlistments  and  other  causes, 

A  check  was  made  at  the  fourth  administration  to  see 
how  many  of  the  men  from  the  original  sample  who  were  still 
in  the  Navy  actually  returned  the  questionnaire.  At  this 
administration  period,  out  of  the  total  number  of  men  avail¬ 
able  to  respond,  88%  actually  did  so.  Thus  the  decline  in 
the  absolute  proportion  of  respondents  reflects  losses  due 
to  attrition  and  not  a  decline  in  the  proportion  of  returns 
out  of  those  available.  The  differences  in  the  number  of 
cases  assigned  to  each  sample  in  the  beginning  was  an  attempt 
to  anticipate  estimated  attrition. 

Effects  Upon  Reenlistment  Intentions 

A  comparison  of  major  interest  in  this  tahle  is  be¬ 
tween  the  * requency  of  response  to  the  questionnaire  and 
reenlistme  :  intention  within  each  time  period.  The  compari¬ 
sons  are  made  between  the  number  of  people  who  have  responded 
to  the  questionnaire  once  versus  twice  (Administrations  2, 

3,  and  4),  once  versus  twice  versus  three  times  (Administra¬ 
tion  6)  and,  once  versus  twice  versus  three  times  versus 
four  times  (Administration  8).  None  of  these  Chi  square 
values  were  significant.  Thus  the  number  of  repeated  expo¬ 
sures  to  the  questionnaire  showed  no  systematic  effect  upon 
the  reenlistment  intention  averages. 

A  comprehensive  analysis  of  the  number  of  men  showing 
a  positive  reenlistment  intention  at  each  administration  is 
presented  in  another  report  (Glickman,  1961). 

Effects  Upon  Actual  Reenlistment 

Additional  comparisons  can  be  made  between  the  follow¬ 
ing*  (1)  the  reenlistment  rate  of  those  who  received  the 
questionnaire  versus  those  who  did  not;  (2)  the  effects  of 
repetition  of  administration  of  the  questionnaire  on  actual 
reenlistment ;  (3)  the  reenlistment  trend  of  those  who  re¬ 
ceived  the  questionnaire  at  different  times. 
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For  the  purposes  of  this  study  all  men  remaining  in  the 
Navy  beyond  the  escpiration  of  their  initial  enlistment  are 
categorized  as  reenllstees. 

In  Table  2,  comparison  is  made  of  the  proportion  of 
men  who  remained  in  the  Navy  among  those  who  did  receive 
and  those  who  did  not  receive  the  questionnaire. 

Table  2  shows  some  tendency  for  a  greater  proportion  of 
the  men  who  received  the  questionnaire  to  remain  in  the  Navy, 
although  the  difference  does  not  quite  reach  the  usual  sig¬ 
nificance  level.  The  relatively  small  number  of  cases  re¬ 
maining  in  the  "none*1  category  puts  a  damper  on  this  test. 
Replications  with  larger  numbers  would  appear  to  be  in  order 
to  provide  a  more  definite  result. 


Tabl e  2 

Proportion  of  Men  in  Navy  After  Expiration 
of  Their  Initial  Enlistment  Date  by 
Administration  of  Questionnaire 


Administration 

Number 

Remaining 

Total 

Proportion 

None 

48 

349 

.14* 

One  or  more  times 

1193 

691? 

.17 

*Two  tailed  p  by  Z  for  difference  between  proportions  * 

.08. 


No  discernible  trend  was  found  between  frequency  of 
administration  of  the  questionnaire  and  actual  reenlistment. 

A  breakdown  of  these  figures  is  given  in  Table  3. 

The  trend  for  time  of  administration  is  given  in  Table  4. 
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Table  3 


Effects  of  Frequency  of  Administration  of 
Questionnaire  on  Actual  Reenlistment 


Administration 
Number  and  Sample 
Identification 

Frequency  of  • 
Administration 

Proportion 

Reenlisting 

Total  in 
Sample 

8D 

4 

.19 

1019 

8G 

3 

.20 

904 

81 

2 

.19 

904 

8K 

1 

.13 

906 

3B 

2 

.13 

451 

3F 

1 

.13 

402 

2A 

2 

.17 

340 

2E 

1 

.17 

329 

Table  4 

Proportion  of  Men  in  Navy  After  Expiration  of  Their 
Enlistment  Termination  Date  by  Administration  Time 


Admini stration 
Time 

Number 

Remaining 

Total 

Proportion 

8 

707 

3733 

.19* 

7 

99 

612 

.16 

6 

95 

572 

.17 

5 

65 

478 

.14 

3 

113 

853 

.13 

2 

114 

669 

.17 

None 

48 

349 

.14 

*Two  tailed  p  by  3  for  8  vs.  none  *  .01. 


Table  4  shows  that  there  is  a  tendency  for  more  men  in 
Administration  8  to  remain  in  the  Navy  than  those  in  the  sam¬ 
ple  that  never  received  the  questionnaire. 
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If  this  result  could  be  obtained  again  using  a  larger 
control  group,  it  would  suggest  that  administration  of  the 
questionnaire  as  opposed  to  non-administration,  has  its 
greatest  eff€>.ct  on  actual  reenlistments  about  six  months 
prior  to  expiration  of  the  original  enlistment. 


SUMMARY 


This  report  is  one  of  a  series  dealing  with  the  atti¬ 
tudes  toward  the  Navy  and  the  career  intentions  of  Naval 
enlisted  men  during  uhe  course  of  their  first  enlistment. 

It  was  found  that  repeated  administration  of  the  Career 
Motivation  questionnaire  (CAMOSUR  XI)  did  not  have  an  ad¬ 
verse  effect  on  the  proportion  of  subjects  returning  the 
questionnaire  nor  on  the  intended  and  actual  reenlistment 
of  the  participants.  Hence  in  further  attitudinal  research 
of  this  nature  it  will  be  possible  to  use  the  same  respond¬ 
ents  several  times,  and  more  complex  and  costly  experimental 
designs  can  thus  be  circumvented. 

Some  tendency  was  also  found  for  those  men  who  received 
a  questionnaire  to  remain  in  the  Navy  more  often  than  did 
those  who  did  not  get  any  questionnaire.  The  administration 
of  the  questionnaire  seemed  to  have  its  most  favorable  ef¬ 
fect  on  the  actual  reenlistmant  of  those  subjects  respond¬ 
ing  six  months  before  the  end  of  their  initial  enlistment. 

A  replication  of  this  aspect  of  the  study  using  a  larger 
control  group  was  recommended. 
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